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Ways that' data can be misused in establishing 
accountability of public higher education are described along with 
approaches to help alleviate the potential adversary relationships 
between postsecondary leaders and state agency personnel. It is 
suggested that scholars fear a future in which educational decisions 
may be made according to numbers or by state agency staff who may 
lack expertise about the issues in higher education. Part of the 
relationship between state agencies and colleges is influenced by the 
analysis of data and subsequent conclusions. It is a political tactic 
to display only those pieces of information that are supportive of a 
preconceived position, and data elements can be aggregated using 
decision rules that maximize some comparative figures and minimize 
others. Data can be manipulated in many ways so as to mislead 
decision-makers, and decision-makers can choose to base judgments on 
only scraps of evidence. Faculty suspect that state agency staff and 
the general public neither understand nor appreciate their unique 
working style or professional role, and institutional administrators 
fear loss of autonomy to manage their own campuses. It is proposed 
that all parties may feel more comfortable if there are clear policy 
statements guaranteeing certain decisions, and responsibilities to 
each group. One necessary step is to develop a Bill of Rights at the 
state level so that all participants will have a clear understanding 
of how the state higher education system is to operate. Additionally, 
a clear statement defining the sequence of events within the planning 
and budgeting processes and specifications for a statewide data base 
and management information system could be developed. Emphasis could 
te placed on collecting only those data elements that are essential 
for the prescribed planning and budgeting process. (SW) 
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PROBLEMS AND ISSUES RELATED 
TO THE DATA GAME 



"When there is little prey, the lions quarrel." 

Moslem Proverb 

The strain of retrenchment is showing in the higher 
education community. Out of the necessity of competing for 
limited clients and funds , institutions often find it less 
attractive to cooperate with one another then to guard 
their own territory. The same can be said for the depart- 
ments and schools on a single campus. Careers are most 
readily built during periods of growth. Most -of the incen- 
tives created by the traditional reward system in higher 
education prompt administrators and faculty to strive to, 
at very least, hold on to the numbers of students and the 
amount of resources they now have. Like the actress who 
does not know how to grow old gracefully, higher education 
seems unable to accept the fact that the priorities of many 
Americans no longer grant top billing to traditional .col- 
leges and universities as the best possible way to garner • 
the greatest good with expenditures of public funds. 

Since no one really expects those with vested interests 
in the traditional higher education establishment to expend 
great energy looking for ways to limit, or even diminish, ^ 
their own role, new agencies to coordinate and monitor the 
several campuses within each . state have been established. 
Understandably, such words as faculty activity analysis, 
cost-benefit accounting, and program complimentation are 
alarming to scholars who honestly feel that the best avail- 
able means of attacking social ills and technological pro- 
blems is through the application of the expertise of academe 
No one can be against efficiency or full disclosure in publi 
organizations. Yet, the spector of a future in which 
educational decisions may be made according to the numbers 
rather than by the powers of philosophical persuasion causes 
a shudder in campus offices f rom the presidential suite to. 
the smallest faculty cubica^. New or strengthened state 
higher education agencies are, by establishing check points 
within the conduit for public funds ,, threatening ^ opportuni- 
ties for upward career mobility as well as limiting campus 
autonomy to launch promising new programs. Established 
academicians find it difficult to accept that state agency 
staff, who frequently are less experienced and prestigious 
than campus leaders, are qualified to make judgments about 
the limitations or future shape of the higher education 
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enterprise. Thus, we have drawn uncertain battle lines 
between state agencies and local institutions and, in some 
cases, between different sets*of institutions. No small 
part of this advisory relationship will be a continuous com- 
petition in what ^could be dubbed the Data Game. 

Data and information are powerful tools. Difficult 
decisions can turn on a single piece of hard fact despite 
a wealth of contrary testimony and opinion. Hard data pro- 
vide a defense f or- the decision-maker under pressure. Thus, 
the central rule of the Da&a Game is that you must obtain 
more and better data than the opposition or, if failing 
that, discredit the opponent's data. A corollary rule cau- 
tions that above all, you should never generate the kind of 
information about your own campus that may prove more useful 
to the coordinators than to your own spokesmen. 

In theory, data are but neutral bits., of descriptive 
information. In reality, this is almost never the case. 
Just as a sound has meaning only where there is an ear to 
hear it, data cannot be -examined in the absence of the 
value systems each of us carries. Told that the student- 
faculty ratio in a given department is 12 to 1, some will 
applaud that fact as a fine accomplishment while others 
will quickly point the accusing finger of fiscal irrespon- 
sibility. The bit of data may be neutral but the viewers 
are seldom unbiased. The whole concept of accountability 
would not be so troublesome if each person could select the 
criteria and standards by which he would be evaluated. 

A popular pastime on the academic cocktail circuit 
during the past few years has been the tellir-g of horror 
stories about the misuse of campus data by those outside 
the academic club. Unfortunately, most of the anecdotes 
are true. However, legislative analysts and state coor- 
dinating agency personnel have no monopoly on the misuse 
of data. The Data Game , is very democratic. Anyone can 
play and institutional people may even have invented the 
sport. 

Several ways to profitably misuse data can readily be 
identified. Perhaps the most widely used strategy in the 
Data Game is to display only those pieces of information . 
that are helpful in supporting your preconceived position. 
In this strategy, half a picture is better than a full view. 
Political candidates speak about their strengths and accom- 
plishments and seldom draw attention to -their past failures 
or personal limitations. We have learned to ipe somewhat 
skeptical of politicians who would have us beliave that they 
?re~ paragons of virtue. We should also become more sopnis- 
ticated in expecting educators to be willing to display 
information about both positive and negative aspects or 



] 9 

iiheir operations. All is not perfection behind the ivy 
walls and educators who appear overly protective of their 
institutions increasingly will lack credibility . 

A second way of manipulating data in support of pre- 
conceived positions is by aggregating data elements using 
decision rules that maximize some comparative figures and 
minimize others. When itemizing our income tax deductions, 
all questionable items become deductions in order to mini- 
mize the taxable income. Sometimes it is difficult for 
educational organizations to resist the temptation to count 
credit hours or allocate costs in such ways as to shape 
statistical reports in their favor. This can prove a dan- 
gerous practice since ft is impossible to maximize more 
than one activity at a time. If the cost of research is 
maximized, the cost of instruction and other activities 
must be minimized. If the tally of graduate credits is^ 
maximized, the total of undergraduate credits fnust be dimin- 
ished or the case for a legitimate curriculum may be com- 
promised. Statistics about educational operations are used 
for multiple decisions and" it is difficult to recalculate 
the statistics -to suit the requirements of every new 
decision that arises. 

There seems. to be. a proclivity among some analysts 
to place 'all kinds of comparative data from several campuses 
in rank order and then assume or imply that relative loca- 
tions on the list indicate relative value or quality of 
performance. Listing the high temperatures for several 
locations in rank order does not tell the reader whether it 
was a nice day in each location. The question** is , nice for 
what? Skiers perceive good weather in one way while those 
hoping to swim at the beach see it quite differently. 
Arraying educational costs in rank order tells us little 
about the effectiveness of the expenditures in acheiving 
unique educational objectives. Listing the most active" 
stocks on the New York Stock Exchange does not tell us if 
any one of them was -a good or poor buy. Listing student- 
faculty ratios from high to low does not indicate if any of 
the courses offered were worthwhile 

Data can be manipulated so as to mislead decision- 
makers. Conversely, decision-makers can choose to base ^ 
judgments. on only scraps of evidence. Either act constitutes 
a misuse of data and shows a lack of responsibility in 
seeking continual improvement in the management of our 
limited educational resources. Reaching decisions about the 
allocation of resources is never easy* However, data and 
analysis should always support clarity and illumination of 
alternatives rather than obscurity or bias. 



Perhaps the most potentially ..damaging misuse of data • 
can stem from the current preoccupation of many planners 
with gathering historical statistics as a basis for future 
planning and budgeting decisions. As well meaning as these 
analysts may be, the mere discovery and perpetuation of 
history may do disservice for both those who seek fiscal 
efficiency and those focusing on curriculum improvement. 
Gamblers wouldn't think of setting odds on sporting events 
on the basis of past win-loss records alone. They always 
consider new events and inject logic into the odds-making 
process. Similarly, discovering the average student-faculty 
ratio or cost per credit across the country may tell us 
nothing about what such statistics should be for a particu- 
lar program in a local college or university. 

Discovering the status quo is certainly worthwhile, but 
not to the exclusion of expending adequate energy and^time 
in building consensus as to the planning parameters that;- 
should be employed for future operations. It may be desir- 
able to perpetuate historical funding and workload policies 
through future budgetary periods. On the other hand, the 
experience of past operations coupled with newly identified 
needs and goals, may - call for radical change in resources 
allocation patterns. More time spent in arriving at plans 
through hard logic related to what it takes to accomplish 
specific educational tasks instead of so much time and 
energy expended in analyzing the historical records would 
stimulate the educational community toward self improvement. 
Few educational planners wish to be fettered by past equa- 
tions, so why not concentrate more effort on what ought to 
• be rather than what has been. 

Sociologists have noted that each person tends to act 
according to the best interests of his group. Members of 
labor unions may have trouble appreciating tne problems or 
management and corporate management may, in turn, fa ^ 1 „^° 
understand the motivations of government officials. Simi- 
larly, those- occupying various roles related to the higher 
education Data Game are most concerned with the potential 
impact on their own positions, .opportunities, and responsi- 
bilities. Faculty, institutional administrators, and state- 
wide coordinators may be viewed as three separate groups 
with differing concerns and views of the possible conse- 
quences of providing more data to other educators and the 
public at large. The reactions of each grcup to the 
development of more mangement information result from a 
combination of perceptions about what is good for higher 
education and what is good for them personally. 

Faculty suscect that those in state agencies and the 
general oublic neither understand nor appreciate f 1 ^; 
unique working style or professional role. -Out of necessity, 
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faculty pursue many interests simultaneously. Instruction , 
is only one facet of the faculty member's activity. Re- 
search and the development of new knowledge and applications, 
as well as counseling with students and providing services 
to public and private organizations through consulting, are 
all part of the comprehensive activities that keep a faculty 
member current and valuable. The very nature of the faculty 
role establishes a situation in which erratic patterns of 
workload, assignments, and accomplishment will occur. 
Exposure of such erratic patterns through analysis and pre- 
sentation of cold facts in isolation from complete explana- 
tion is alarming to faculty.' 

Those who talk of mandating standard workload assign- 
ments for faculty show a lack of appreciation for the reali- 
ties of the faculty condition. Faculty. are jealous of their 
professional role that requires a large measure of self- 
direction. They feel that progress is made by those with 
the freedom to' try new ideas and manage their own resources. 
Any use of data that tends to limit the entrepreneurial 
latitude of faculty will quickly be resented and resisted. 
Faculty are fearful of being turned into production line 
employees in the name of efficiency and feel that such a . 
move must ultimately damage the quality of instruction, _ 
especially at the graduate level. The wise _ use of data and 
planning information should avoid destruction of the incen- 
tives of faculty as self-directed professionals and simul- 
taneously establish planning strategies that direct the 
limited educational resources to needed programs in fair - 
proportions. 

Like faculty, institutional administrators fear loss 
of autonomy to manage their own campuses. Governmental 
preoccupation with scrutinizing operational details limits 
tit administrators' ability to use their alloted resources, 
as they think best to achieve the goals of the ^1^031 
in addition, too much control from above denies opportunities 
to start promising new activities that help maintain a 
dynamic organization. Most administrators are intensely 
"aware of the political processes that can quic kly l^d_to 
the capricious use of data as a weapon against the institu 
Son. in the heat of rough and tumble state politics, data 
may quickly be turned to uses for which they were never 
intended. To the extent that mistrust in the f a irn ®" °* 
lit political process exists, administrators understandably 
will wish to have less data rather than more available to 
bureaucratic statewide planning agencies. 

Perhaps' there is also more than a little fear on the 
part of administrators that they will appear to be m charge 
of poorly run organizations when judged by the criteria of 
^business world. Again, the conflict between business- 
like efficiency and decentralization of decision -making that 



has been held so imoortant in the university setting may 
be highlighted by an over abundance of analysis and data. 
Most administrators would be quite willing to tell it like 
it is" if others would try to understand that colleges are 
not factories and the curricula are not assembly lines. 

Those in statewide higher education coordinating 
aqencies are also under considerable pressure when parti- 
cipating in the Data Game. Many are" in relatively new posi- 
tions without established prestige or credibility. They 
must justify their existence to legislatures and executive 
offices by demonstrating their ability to plan effectively 
for the state's postsecondary education network. Currently, 
they must rely almost totally on data provided by the 
individual campuses for their planning processes. Thus, 
the institutions have the power to control the statewide 
planning process by the flow of data they are either able 
or willing to report. 

An unfortunate adversary relationship has arisen between 
institutional leaders and state agency personnel. The kind 
of mutual trust that would enhance opportunities for elec- 
tive statewide planning most frequently do not exist. , 
Statewide personnel frequently' feel that institutional 
representatives wish to thwart their efforts and render 
them ineffective in accomplishing the statewide planning 
function upon which their existence depends. Lacking the 
experience and prestige of major campus leaders, they often 
feel disadvantaged or insecure when meeting institutional 
representatives at the conference table. This leads to 
a tSSSS to avoid involvement with .. campus , leaders whenever 
possible and simply plan for them rather than with them. 
A lack of interaction in the statewide planning and budgeting 
process can only intensify the feelings of suspicion, and 
resentment on local campuses. 

•in such an atmosphere of adversary relationships com- 
pounded by honestly held differences of °?^ 1 ° n r ^°^ i ^ Ca 
Clonal priorities, the Data Game may provide a convenient 
battleground. The state agency requests data and the 
initiations reply, "first tell us what you intend to do 
with i?!" The squabbling can be both frustrating and em- 
barrassing to all parties. To the general public and its 
rtprelenSltives instate and federal government, higher 
education is seen as being unable or unwilling to coalesce 
in deference to the public good. The consequence may be 
more of the very kinds of centralized. control and demands 
?or stringent accountability that are most: fearec by t.ie 
institution. 

. ' Clearly, it would be in the best interest of all con- 
cerned for higher education groups to cooperate in an er.ort 
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to design a reasonable and " laudable plan in each state and 
then present united support for the funding of that plan. 
Data and analysis would play a significant role in such an 
approach providing the time honored Data Game strategies t 
can be cast aside. Data resulting .from historical, analysis 
are not answers. If they are perceived to be answers, the 
wrong questions are being asked. Historical analysis is 
important in letting educators know where they have been 
so they can determine better where they want to go. His- 
torical norms must not automatically become- frozen policy 
for then the flexibility to deal effectively with future 
needs and opportunities will t be lost. In most stages, current 
statewide planning approaches are less than satisfactory to 
all concerned parties. The major question for the future 
is, "How. can a planning process be devised that will meet 
the basic needs of faculty, various kinds of institutions, 
statewide planners and ^public good?" Finding an answer 
to that question shouldjtoe a primary concern, in every state. 

The chore of replacing .the current Data Game with a 
more acceptable planning process may be accomplished if 
three sequential tasks are completed. Fir^t, a more com- 
plete delineation of the prerogratives and areas of autonomy 
attached to each level of educational manag^mfent should be 
developed at the statewide level and' reviewed periodically. - 
The Carnegie Commission has called such statements of policy 
an educational" Bill of Rights. Faculty, campus administra- 
tors and state agency personnel will all feel more comfort- 
able if there are clear policy statements guaranteeing 
certain decisions and responsibilities to each group. Fac- 
ulty need assurance that the governance process will not 
encroach upon their right to guide the curriculum, parti- 
cipate in appointment of colleagues or manage their own 
resources. Campus administrators will feel more comfortable 
with written policies assuring them control over management 
of. internal affairs. State agency personnel need to know 
the limits and imperatives of their responsibility in evalu- 
ating programs and budgets and developing a master plan for ; 
post-secondary education. In short, the enabling legislation 
that establishes most state coordinating boards rs too vague 
and broad to lend clear definition for how the state higher 
education system is to operate. The" result is a pushing and 
shoving : match in which each higher education faction seeks 
to carve out the largest possible domain for its own control. 
An educational Bill of Rights is needed at the statewide level 
so .Jtt all 'participants will know the rules of the game. 
The cime to establish policy is before crises occur rather 
than in the heat of jurisdictional disputes. Since the 
jurisdictional disputes . have already arisen, the construction 
of the suggested educational Bill of Rights will be a* very 
difficult , albeit important, undertaking. 



management data are misused by the state agency, institu- 
tional allegiance to the-prescribed statewide planning - 
process will be shattered and the. old Data Game will start 
again. Two basic principles that state agencies should ; ,. 
remember in order to avoid shattering the fragile consensus 
surrounding the planning process are: (1) be scrupulously 
accurate with any information displays about institutions, 
always giving institutions an opportunity to criticize 
reports before they are published, and (2) concede that 
reaching consensus pertaining to what ought to be is more 
important than' historical analyses that tend to perpetuate 
what has been. 

Smoothing of-the statewide planning process will require 
a lot of give and take by all parties. Institutions will 
need to' provide data in support of differential fundirfg 
formulas for various program clusters at different student 
levels. State agencies must agree not to tamper with inter- 
nal institutional management .problems : In addition, state- 
wide coordinating agency personnel must begin to be. viewed 
as true advocates for education, but ; institutions must 
acknowledge that advocacy does not mean simply carrying . 
every message each institution proposes to the legislature. 
In short, what "is needed are more educational statesmen and 
fewer educational politicians. Leaders at both the state- 
wideband institutional levels who are able to take a broad, • 
long-range view and rise above the current bickering may . 
make a major contribution. Human nature and material 
incentives will always preclude perfect harmony . However, 
any measure of improved cooperation among institutions and ^ 
agencies based on hard won cdnsensus will help higher educa- 
tion regain public confidence and support. 

• ~ • \f • 

The technology for effective planning and management 
systems now exists- but, as usual, €he technological advance- 
ments have surged ahead of the human capacity to fully 
utilize them. We must-, first 'reach a higher level of cooper- - 
ation and trust if we ever intend to stop playing the Data 
Game and put, to rest the accusation that higner education 
.is interested in studying everything except itself.. . 



